TITLE OF THE INVENTION 
IMAGE PROCESSING APPARATUS AND METHOD THEREOF 



FIELD OF THE INVENTION 

The present invention relates to an image 
processing apparatus and method thereof and, more 
particularly,, to image processing based on the 
relationship between an input system and an output 
system of an image signal. 

BACKGROUND OF THE INVENTION 

Along with the recent development of image 
processing technology, image input apparatuses such as 
a digital camera for sensing an object and outputting 
its image signal are showing a remarkable consummation 
rush. 

Image input apparatuses are roughly classified 
into a type that processes RGB signals as colorimetric 
data of an object and a type that executes multiple 
spectral distribution data processing by estimating the 
colorimetric data of an object illuminated with ambient 
light using the spectral distribution data of an object 
and that of the ambient light with which the object is 
illuminated. The former requires a short processing 
time and is advantageous in terms of cost because the 
processing is simple. On the other hand, the latter 
requires complex processing and therefore is 



disadvantageous in processing time and cost, though it 
can realize more accurate color reproduction. 

Some apparatuses execute simple RGB/spectral 
distribution data processing while realizing accurate 
5 color reproduction by multiple spectral distribution 
data pressing by estimating spectral distribution data 
on the basis of received RGB signals. 

In each of the above image input apparatuses, the 
internal signal processing system is limited to one of 

10 the RGB signal processing system, multiple spectral 

distribution data processing system, and RGB/spectral 
distribution data processing system, and has input and 
output units corresponding to one of the processing 
systems. That is, an image input apparatus having an 

15 RGB signal processing system has an RGB input unit and 
RGB output unit. An image input apparatus having a 
multiple spectral distribution data processing has a 
spectral distribution input unit and spectral 
distribution processing unit. An image input apparatus 

20 having an RGB/spectral distribution data processing 
system has an RGB input unit and RGB/spectral 
distribution processing unit. 

Hence, input and output units for different 
signal processing systems cannot be connected to a 

25 single image input apparatus. For example, an output 

unit for a spectral distribution data processing system 
cannot be connected to an input unit for an RGB signal 



processing system. 



SUMMARY OF THE INVENTION 
The present invention has been made to solve the 
5 above-described problems individually or altogether, 

and has as its object to provide image processing based 
on the relationship between the signal processing 
systems of image input and output units. 

In order to achieve the above object, according 

10 to a preferred aspect of the present invention, the 
foregoing object is attained by providing an image 
processing apparatus comprising: an input unit, 
arranged to input image data; an output unit, arranged 
to output the image data to an external device; and a 

15 controller, arranged to control a signal format of the 
image data to be supplied from the input unit to the 
output unit on the basis of a signal format of image 
data that can be processed by the output unit. 

In a preferred embodiment, the controller 

20 acquires information related to an input signal format 
of image data that can be input by the input unit and 
information related to an output signal format of the 
image data that can be processed by the output unit and, 
on the basis of the acquired information related to the 

25 input and output signal formats, controls the signal 

format of the image data to be supplied from the input 
unit to the output unit. 



According to another aspect of the present 
invention the foregoing object is attained by providing 
a converter, arranged to convert the signal format of 
the image data input from the input unit, wherein when 
image data having a signal format corresponding to the 
output signal format is not input from the input unit, 
the controller supplies image data obtained by 
converting the signal format by the converter to the 
output unit. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 
the same or similar parts throughout the figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram showing the functional 

arrangement of an image input apparatus according to 

the first embodiment; 

Fig. 2 is a block diagram showing the connection 

state of each unit; 

Fig . 3 is a flow chart showing image input 

processing; 

Fig. 4 is a block diagram showing the functional 
arrangement of an image input apparatus according to 
the second embodiment; 

Fig. 5 is a graph showing examples of color 



matching functions; 

Fig. 6 is a graph showing an example of an RGB 
spectral distribution characteristic; and 

Fig. 7 is a table showing the correlation between 
5 the signal formats of input and output systems and the 
signal formats of image data to be output to the output 
system. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

10 Image input apparatuses according to the 

embodiments of the present invention will be described 
below in detail with reference to the accompanying 
drawings . 
First Embodiment 

15 [Arrangement] 

Fig. 1 is a block diagram showing the functional 
arrangement of an image input apparatus according to 
the embodiment . 

An input unit 201 for photographing an object and 

20 acquiring image data has a colorimetric data input 

section 202 for acquiring the colorimetric data (RGB 
data in this embodiment) of each pixel and a spectral 
distribution data input section 203 for acquiring the 
spectral distribution data of each pixel. The 

25 colorimetric data and spectral distribution data 

acquired in the input unit 201 are input to an image 
processing unit 204. 
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The image processing unit 204 is constituted by 
an input system information acquisition section 205 for 
acquiring characteristic information of the input 
system (to be referred to as "input system information" 
5 hereinafter) such as a signal format in the input unit 
201 (to be referred to as an "input signal format" 
hereinafter) , an output system information acquisition 
section 206 for acquiring characteristic information of 
the output system (to be referred to as "output system 

10 information" hereinafter) such as a signal format in an 
output unit 208 on the output side (to be referred to 
as an "output signal format" hereinafter) , and an 
output signal selection section 207 for selecting the 
signal format of image data to be transferred to the 

15 output unit 208 on the basis of the acquired input and 
output system information. The image processing unit 
204 outputs image data having a signal format selected 
by the output signal selection section 207. 

The image data output from the image processing 

20 unit 204 is subjected to appropriate image processing 

by the output unit 208 and output to an external device. 
In the first embodiment, as the output unit 208, a 
plurality of processing units using different 
processing signal formats can be used. More 

25 specifically, one of a colorimetric processing output 
unit 209 for receiving only colorimetric data and 
processing/outputting the data, a colorimetric/spectral 



distribution processing output unit 210 for receiving 
both colorimetric data and spectral distribution data 
and processing/outputting the data, and a spectral 
distribution processing output unit 211 for receiving 
5 only spectral distribution data and 

processing/outputting the data can be connected to the 
image processing unit 204 as the output unit 208. 

Fig. 2 is a block diagram showing the connection 
state of each unit of the image input apparatus shown 
10 in Fig. 1. 

Referring to Fig. 2, the input unit 201 has, in 
addition to the above-described colorimetric data input 
section 202 and spectral distribution data input 
section 203, an image processing section 801 for 
15 executing processing such as analog-to-digital 

conversion or shading correction for image data having 
a signal format, which is acquired by the colorimetric 
data input section 202 and spectral distribution data 
input section 203, and a communication interface 
20 section 802 for transmitting the processed image data 
to the image processing unit 204 on the output side. 

The image processing unit 204 has, in addition to 
a selection processing section 805 formed from the 
above-described input system information acquisition 
25 section 205, output system information acquisition 

section 206, and output signal selection section 207, 
an image processing section 804 for executing image 
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processing according to the signal format selected by 
the selection processing section 805 on the image data, 
and a communication interface section 803 for 
transmitting the processed image data to the output 
unit 208 and receiving image data from the input unit 
201. 

The output unit 208 has a communication interface 
section 806 for receiving image data from the image 
processing unit 204, an image processing section 807 
for analyzing received image data and generating output 
image data, and an output section 808 for outputting 
the generated output image data to an external device 
(not shown) . 

As shown in Fig. 2, the units (input unit 201, 
image processing unit 204, and output unit 208) of the 
image input apparatus according to the first embodiment 
can exchange image data and the characteristic 
information of each unit through the communication 
interface sections 802, 803, and 806. 
[Processing] 

Image input processing in the above-described 
image input apparatus according to the first embodiment 
will be described below in detail with reference to 
Fig. 3. 

Fig. 3 is a flow chart showing processing of 
causing the input unit 201 to receive colorimetric data 
and spectral distribution data and output image data 



having a signal format that can be processed by the 
output unit 208. 

In step S300, the input unit 201 acquires image 
data obtained by photographing an object. In the first 
5 embodiment, colorimetric data and spectral distribution 
data are acquired by the colorimetric data input 
section 202 and spectral distribution data input 
section 203, respectively. 

In step S301, the input system information 
10 acquisition section 205 acquires the input system 

information of the input unit 201. In step S302, the 
output system information acquisition section 206 
acquires the output system information of the output 
unit 208. That is, the characteristic information of 
15 each of the colorimetric data input section 202 and 
spectral distribution data input section 203 in the 
input unit 201 is acquired as input system information, 
and the characteristic information of the output unit 
208 currently connected to the image processing unit 
20 204, i.e., the colorimetric processing output unit 209, 
colorimetric/spectral distribution processing output 
unit 210, or spectral distribution processing output 
unit 211 is acquired as output system information. 

To cause the output unit 208 connected to the 
25 image processing unit 204 to process and output the 

image data acquired in step S300, processing in steps 
S303 to S307 is executed by the output signal selection 
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section 207, and image data having a signal format to 
be output to the output unit 208 is selected from the 
image data acquired by the input unit 201. Processing 
in the output signal selection section 207 will be 
5 described below. 

In step S303, on the basis of the input system 
information acquired in step S301, pieces of 
information related to the input signal formats of the 
image data acquired by the input unit 201 are obtained. 

10 The input signal formats mean the signal formats of the 
image data acquired by the input unit 201, i.e., a 
"colorimetric form" corresponding to the image data 
acquired by the colorimetric data input section 202 and 
a "spectral distribution form" corresponding to the 

15 image data acquired by the spectral distribution data 
input section 203. 

In step S304, on the basis of the output system 
information acquired in step S302, information related 
to the output signal format of image data that can be 

20 processed by the output unit 208 is obtained. The 

output signal format means the signal format of image 
data that can be processed by the output unit 208 
currently connected to the image processing unit 204, 
i.e., a "colorimetric form" corresponding to the signal 

25 format of image data that can be processed by the 
colorimetric processing output unit 209, the 
"colorimetric/spectral distribution form" corresponding 
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to the signal format of image data that can be 
processed by the colorimetric/spectral distribution 
processing output unit 210, or the "spectral 
distribution form" corresponding to the signal format 
of image data that can be processed by the spectral 
distribution processing output unit 211. 

In step S305, on the basis of the information 
related to the output signal format obtained in step 
S304, the signal format of image data to be output from 
the image processing unit 204 to the output unit 208 is 
determined. More specifically, when the colorimetric 
processing output unit 209 is connected as the output 
unit 208, the "colorimetric form" is determined. When 
the colorimetric/spectral distribution processing 
output unit 210 is connected, both the "colorimetric 
form" and the "spectral distribution form" are 
determined. When the spectral distribution processing 
output unit 211 is connected, the "spectral 
distribution form" is determined. 

In step S306, image data having the output signal 
format determined in step S305 is selected from the 
image data acquired in step S300. The image data is 
output to the output unit 208 in step S307 . 

The image data output to the output unit 208 by 
the above steps has a signal format that matches the 
signal format that can be processed by the output unit 
208. Hence, the output unit 208 can execute 



predetermined image processing on the basis of the 
image data received from the image processing unit 204 
to generate an appropriate output signal and output the 
signal to an external device. 
5 In the first embodiment, in accordance with the 

signal format that can be processed by the output unit 
208 connected to the image processing unit 204, 
colorimetric data is output to the colorimetric 
processing output unit 209, both colorimetric data and 

10 spectral distribution data are output to the 

colorimetric/spectral distribution processing output 
unit 210, and spectral distribution data is output to 
the spectral distribution processing output unit 211. 
As described above, according to the first 

15 embodiment, image data having a signal format that can 
be processed by the output unit 208 can be selected 
from image data acquired by the input unit 201 and 
supplied to the output unit 208. Hence, an image input 
apparatus in which the input signal format in the input 

20 unit 201 is not limited to the output signal format in 
the output unit 208 can be implemented. In other words, 
in an image input apparatus having the input unit 201 
for inputting colorimetric data and spectral 
distribution data, one of the colorimetric processing 

25 output unit 209, colorimetric/spectral distribution 

processing output unit 210, and spectral distribution 
processing output unit 211 can be arbitrarily connected 



- 12 - 



and used as the output unit 208. 

Generally, as the colorimetric processing output 
unit 209, for example, a device for executing simple 
RGB data processing is assumed. However, as the 
5 colorimetric/spectral distribution processing output 
unit 210 or spectral distribution processing output 
unit 211, a multiple spectral distribution data 
processing device for realizing highly accurate color 
reproduction is assumed. Hence, according to the first 

10 embodiment, in the image input apparatus, a highly 
accurate color reproduction processing device 
(colorimetric/spectral distribution processing output 
unit or spectral distribution processing output unit) 
can be connected while maintaining the compatibility 

15 with an inexpensive normal device (colorimetric 
processing output unit) . 
Second Embodiment 

The second embodiment of the present invention 
will be described below. 

20 In the above-described first embodiment, an 

arrangement in which the input unit 201 has both the 
colorimetric data input section 202 and the spectral 
distribution data input section 203 has been described. 
In the second embodiment, only a spectral distribution 

25 data input section 203 is prepared as an input unit, 
and colorimetric data is generated in accordance with 
the output signal format of an output unit 208. 
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[Arrangement] 

Fig. 4 is a block diagram showing the 
characteristic functional arrangement of an image input 
apparatus according to the second embodiment. The same 
5 reference numerals as in the above-described first 

embodiment denote the same components in Fig. 4, and a 
description thereof will be omitted. 

The output signal selection section 207 in the 
first embodiment selects image data having a signal 

10 format to be output from image data having signal 

formats acquired by the input unit 201. However, an 
output signal selection section 404 in the second 
embodiment determines the signal format of image data 
to be output on the basis of the output signal format 

15 of the output unit 208 independently of the input 
signal format of an input unit 201. 

As in the first embodiment, an output system 
information acquisition section 406 in an image 
processing unit 402 shown in Fig. 4 acquires the output 

20 system information of the output unit 208 ( colorimetric 
processing output unit 209, colorimetric/spectral 
distribution processing output unit 210, or spectral 
distribution processing output unit 211) currently 
connected to the image processing unit 402. In the 

25 second embodiment, since only the spectral distribution 
data input section 203 is prepared as the input unit, 
no input system information acquisition section for 
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acquiring input system information is prepared. 
However, an input system information acquisition 
section may be prepared, as in the first embodiment. 
On the basis of the output system information 
5 acquired by the output system information acquisition 
section 406, the output signal selection section 404 
determines the signal format of image data to be output 
from the image processing unit 4 02 to the output unit 
208 from signal formats that are prepared in advance. 

10 The signal formats that are prepared in advance are the 
"colorimetric form", "colorimetric/spectral 
distribution form", and "spectral distribution form". 

In the second embodiment, since only the spectral 
distribution data input section 203 is prepared as the 

15 input unit, no colorimetric data is input. Hence, when 
the "colorimetric form" or "colorimetric/spectral 
distribution form" is selected by the output signal 
selection section 404, a colorimetric data generation 
section 403 generates colorimetric data on the basis of 

20 spectral distribution data input from the spectral 

distribution data input section 203. The colorimetric 
data generation method will be described later in 
detail . 

Upon receiving the spectral distribution data 
25 from the spectral distribution data input section 203 
and the colorimetric data from the colorimetric data 
generation section 403, an output signal switching 
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section 4 05 switches image data to be output from the 
image processing unit 402 on the basis of the output 
signal format determined by the output signal selection 
section 404. More specifically, when the output signal 
5 format is the "colorimetric form", the output signal 
switching section 405 outputs only the colorimetric 
data. When the output signal format is the 
"colorimetric/spectral distribution form", the output 
signal switching section 405 outputs both the 

10 colorimetric data and the spectral distribution data. 
When the output signal format is the "spectral 
distribution form", the output signal switching section 
405 outputs only the spectral distribution data. 
[Generation of Colorimetric Data] 

15 The colorimetric data generation method by the 

colorimetric data generation section 403 will be 
described here. 

As the first method, received spectral 
distribution data is temporarily converted into 

20 device-independent colorimetric vector data and then 
converted into colorimetric data on the target 
colorimetric system (e.g., RGB system). 

That is, when spectral distribution data received 
from the spectral distribution data input section 203 

25 is integrated by convolution calculation of a color 
matching function in an appropriately selected 
colorimetric system, the spectral distribution data can 
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be converted into colorimetric vector data (tristimulus 
values) having ternary values. As colorimetric vector 
data having ternary values, a device-independent 
colorimetric system such as an L*a*b* colorimetric 
5 system or XYZ colorimetric system is generally employed. 
Fig. 5 is a graph showing examples of color matching 
functions in the XYZ colorimetric system. 

As the second method, three data are selected 
from a plurality of wavelength data contained in the 

10 received spectral distribution data, and these data are 
converted into ternary values of colorimetric data. 

That is, the spectral characteristic of target 
colorimetric data is held in advance. Only data 
corresponding to the spectral characteristic of the 

15 colorimetric data are extracted from received spectral 
distribution data and converted into colorimetric data. 
For example, assume that colorimetric data contains RGB 
signals. Since RGB signals have spectral 
characteristics shown in Fig. 6, three wavelength data 

20 that exhibit the peaks of the RGB colors are extracted 
from the received spectral distribution data. On the 
basis of these data, RGB signal values can be generated. 

As described above, according to the second 
embodiment, image data having an unacquired signal 

25 format is generated as needed, thereby outputting image 
data having a signal format that can be processed by 
the output unit 208. Hence, as in the first embodiment, 
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in an image input apparatus for acquiring only spectral 
distribution data, one of the colorimetric processing 
output unit 209, colorimetric/spectral distribution 
processing output unit 210, and spectral distribution 
5 processing output unit 211 can be arbitrarily connected 
and used as the output unit 208. 
Other Embodiment 

In the first embodiment, a case wherein the input 
unit 201 acquires colorimetric data and spectral 

10 distribution data has been described. In the second 
embodiment, a case wherein only spectral distribution 
data is acquired has been described. However, the 
present invention is not limited to these examples. 
Fig. 7 shows the correlation between the input signal 

15 format, the output signal format, and the signal format 
of image data to be output to the output unit. 
Referring to Fig. 7, the column wherein the input 
signal format is "colorimetric and spectral 
distribution form" corresponds to the above-described 

20 first embodiment, and the column wherein the input 
signal format is "spectral distribution form" 
corresponds to the second embodiment. 

According to Fig. 7, when the input signal format 
is the "colorimetric form", i.e., when only 

25 colorimetric data is input from the input unit, no 

spectral distribution data can be formed on the basis 
of the colorimetric data. Hence, only when the output 



signal format is the "colorimetric form", appropriate 
image data (colorimetric data) can be output to the 
output unit. Otherwise, i.e., when the output signal 
format is the "colorimetric/spectral distribution form" 
or "spectral distribution form", image data having an 
appropriate signal format cannot be output to the 
output unit. 

The correlation table shown in Fig. 7 is held in 
a memory (not shown) in the image input apparatus and 
looked up in, e.g., determining the output signal 
format on the basis of the signal formats of the input 
and output units in step S305 of Fig. 3. If the input 
signal format is the "colorimetric form", as described 
above, and the output signal has a form other than the 
"colorimetric form", i.e., when image data cannot be 
output to the output unit, the user is preferably 
notified of the error in step S305. 

As described above, for all combinations of input 
and output signal formats, the signal format of 
corresponding image data is determined in advance. 
With this arrangement, not only as the output unit but 
also as the input unit, an input unit for receiving 
only colorimetric data, an input unit for receiving 
both colorimetric data and spectral distribution data, 
or an input unit for receiving only spectral 
distribution data can be arbitrarily connected to the 
image input apparatus and used. 



Hence, the input and output units can be detached 
from the image input unit. Even when the attached 
input and output units use different signal formats, an 
appropriate image processing can be executed. 
5 In the above-described embodiments, RGB data is 

most generally used as colorimetric data. 

As many apparently widely different embodiments of 
the present invention can be made without departing from 
10 the spirit and scope thereof, it is to be understood 
that the invention is not limited to the specific 
embodiments thereof except as defined in the appended 
claims . 
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